High‐dimensional regression coefficient estimation by nuclear norm plus l1 norm penalization
نویسندگان
چکیده
We propose a new estimator of the regression coefficients for high-dimensional linear model, which is derived by replacing sample predictor covariance matrix in ordinary least square (OLS) with different estimate obtained nuclear norm plus l 1 penalization. call ALgebraic Covariance Estimator-regression (ALCE-reg). make direct theoretical comparison expected mean error ALCE-reg OLS and RIDGE. show simulation study that particularly effective when both dimension size are large, due to its ability find good compromise between large bias shrinkage estimators (like RIDGE absolute selection operator [LASSO]) variance conditioned principal orthogonal complement thresholding [POET]).
منابع مشابه
L1-Norm Quantile Regression
Classical regression methods have focused mainly on estimating conditional mean functions. In recent years, however, quantile regression has emerged as a comprehensive approach to the statistical analysis of response models. In this article we consider the L1-norm (LASSO) regularized quantile regression (L1-norm QR), which uses the sum of the absolute values of the coefficients as the penalty. ...
متن کاملNuclear-L1 Norm Joint Regression for Face Reconstruction and Recognition
Recognizing a face with significant lighting, disguise and occlusion variations is an interesting and challenging problem in pattern recognition. To address this problem, many regression based methods, represented by sparse representation classifier (SRC), are presented recently. SRC uses the L1-norm to characterize the pixel-level sparse noise but ignore the spatial information of noise. In th...
متن کاملL1-norm Penalised Orthogonal Forward Regression
A l-norm penalized orthogonal forward regression (l-POFR) algorithm is proposed based on the concept of leaveone-out mean square error (LOOMSE). Firstly, a new l-norm penalized cost function is defined in the constructed orthogonal space, and each orthogonal basis is associated with an individually tunable regularization parameter. Secondly, due to orthogonal computation, the LOOMSE can be anal...
متن کاملWeighted isotonic regression under the L1 norm
Isotonic regression, the problem of finding values that best fit given observations and conform to specific ordering constraints, has found many applications in biomedical research and other fields. When the constraints form a partial ordering, solving the problem under the L1 error measure takes O(n) when there are n observations. The analysis of large-scale microarray data, which is one of th...
متن کاملRoom impulse response estimation by iterative weighted L1-norm
This paper presents a novel method to solve for the challenging problem of acoustic Room Impulse Response estimation (RIR). The approach formulates the RIR estimation as a Blind Channel Identification (BCI) problem and it exploits sparsity and non-negativity priors to reduce illposedness and to increase robustness of the solution to noise. This provides an iterative procedure based on a reweigh...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Stat
سال: 2023
ISSN: ['2049-1573']
DOI: https://doi.org/10.1002/sta4.548